Behavior Monitoring Using Visual Data and Immersive Environments

University of Minnesota Ph.D. dissertation.August 2017. Major: Computer Science. Advisor: Nikolaos Papanikolopoulos. 1 computer file (PDF); viii, 99 pages.Mental health disorders are the leading cause of disability in the United States and Canada, accounting for 25 percent of all years of life lost to disability and premature mortality (Disability Adjusted Life Years or DALYs). Furthermore, in the United States alone, spending for mental disorder related care amounted to approximately $201 billion in 2013. Given these costs, significant effort has been spent on researching ways to mitigate the detrimental effects of mental illness. Commonly, observational studies are employed in research on mental disorders. However, observers must watch activities, either live or recorded, and then code the behavior. This process is often long and requires significant effort. Automating these kinds of labor intensive processes can allow these studies to be performed more effectively. This thesis presents efforts to use computer vision and modern interactive technologies to aid in the study of mental disorders. Motor stereotypies are a class of behavior known to co-occur in some patients diagnosed with autism spectrum disorders. Results are presented for activity classification in these behaviors. Behaviors in the context of environment, setup and task were also explored in relation to obsessive compulsive disorder (OCD). Cleaning compulsions are a known symptom of some persons with OCD. Techniques were created to automate coding of handwashing behavior as part of an OCD study to understand the difference between subjects of different diagnosis. Instrumenting the experiment and coding the videos was a limiting factor in this study. Varied and repeatable environments can be enabled through the use of virtual reality. An end-to-end platform was created to investigate this approach. This system allows the creation of immersive environments that are capable of eliciting symptoms. By controlling the stimulus presented and observing the reaction in a simulated system, new ways of assessment are developed. Evaluation was performed to measure the ability to monitor subject behavior and a protocol was established for the system's future use

Gene expression profiling of mucinous ovarian tumors and comparison with upper and lower gastrointestinal tumors identifies markers associated with adverse outcomes.

PURPOSE: Advanced-stage mucinous ovarian carcinoma (MOC) has poor chemotherapy response and prognosis and lacks biomarkers to aid stage I adjuvant treatment. Differentiating primary MOC from gastrointestinal (GI) metastases to the ovary is also challenging due to phenotypic similarities. Clinicopathologic and gene-expression data were analyzed to identify prognostic and diagnostic features. EXPERIMENTAL DESIGN: Discovery analyses selected 19 genes with prognostic/diagnostic potential. Validation was performed through the Ovarian Tumor Tissue Analysis consortium and GI cancer biobanks comprising 604 patients with MOC (n = 333), mucinous borderline ovarian tumors (MBOT, n = 151), and upper GI (n = 65) and lower GI tumors (n = 55). RESULTS: Infiltrative pattern of invasion was associated with decreased overall survival (OS) within 2 years from diagnosis, compared with expansile pattern in stage I MOC [hazard ratio (HR), 2.77; 95% confidence interval (CI), 1.04–7.41, P = 0.042]. Increased expression of THBS2 and TAGLN was associated with shorter OS in MOC patients (HR, 1.25; 95% CI, 1.04–1.51, P = 0.016) and (HR, 1.21; 95% CI, 1.01–1.45, P = 0.043), respectively. ERBB2 (HER2) amplification or high mRNA expression was evident in 64 of 243 (26%) of MOCs, but only 8 of 243 (3%) were also infiltrative (4/39, 10%) or stage III/IV (4/31, 13%). CONCLUSIONS: An infiltrative growth pattern infers poor prognosis within 2 years from diagnosis and may help select stage I patients for adjuvant therapy. High expression of THBS2 and TAGLN in MOC confers an adverse prognosis and is upregulated in the infiltrative subtype, which warrants further investigation. Anti-HER2 therapy should be investigated in a subset of patients. MOC samples clustered with upper GI, yet markers to differentiate these entities remain elusive, suggesting similar underlying biology and shared treatment strategies

CCNE1 and survival of patients with tubo-ovarian high-grade serous carcinoma: An Ovarian Tumor Tissue Analysis consortium study

BACKGROUND: Cyclin E1 (CCNE1) is a potential predictive marker and therapeutic target in tubo-ovarian high-grade serous carcinoma (HGSC). Smaller studies have revealed unfavorable associations for CCNE1 amplification and CCNE1 overexpression with survival, but to date no large-scale, histotype-specific validation has been performed. The hypothesis was that high-level amplification of CCNE1 and CCNE1 overexpression, as well as a combination of the two, are linked to shorter overall survival in HGSC. METHODS: Within the Ovarian Tumor Tissue Analysis consortium, amplification status and protein level in 3029 HGSC cases and mRNA expression in 2419 samples were investigated. RESULTS: High-level amplification (>8 copies by chromogenic in situ hybridization) was found in 8.6% of HGSC and overexpression (>60% with at least 5% demonstrating strong intensity by immunohistochemistry) was found in 22.4%. CCNE1 high-level amplification and overexpression both were linked to shorter overall survival in multivariate survival analysis adjusted for age and stage, with hazard stratification by study (hazard ratio [HR], 1.26; 95% CI, 1.08-1.47, p = .034, and HR, 1.18; 95% CI, 1.05-1.32, p = .015, respectively). This was also true for cases with combined high-level amplification/overexpression (HR, 1.26; 95% CI, 1.09-1.47, p = .033). CCNE1 mRNA expression was not associated with overall survival (HR, 1.00 per 1-SD increase; 95% CI, 0.94-1.06; p = .58). CCNE1 high-level amplification is mutually exclusive with the presence of germline BRCA1/2 pathogenic variants and shows an inverse association to RB1 loss. CONCLUSION: This study provides large-scale validation that CCNE1 high-level amplification is associated with shorter survival, supporting its utility as a prognostic biomarker in HGSC

LearnIt: On-Demand Rapid Customization for Event-Event Relation Extraction

We present a system which allows a user to create event-event relation extractors on-demand with a small amount of effort. The system provides a suite of algorithms, flexible workflows, and a user interface (UI), to allow rapid customization of event-event relation extractors for new types and domains of interest. Experiments show that it enables users to create extractors for 6 types of causal and temporal relations, with less than 20 minutes of effort per type. Our system (source code, UI) is available at https://github.com/BBN-E/LearnIt. A demonstration video is available at https://vimeo.com/329950144

MCM3 is a novel proliferation marker associated with longer survival for patients with tubo-ovarian high-grade serous carcinoma

Tubo-ovarian high-grade serous carcinomas (HGSC) are highly proliferative neoplasms that generally respond well to platinum/taxane chemotherapy. We recently identified minichromosome maintenance complex component 3 (MCM3), which is involved in the initiation of DNA replication and proliferation, as a favorable prognostic marker in HGSC. Our objective was to further validate whether MCM3 mRNA expression and possibly MCM3 protein levels are associated with survival in patients with HGSC. MCM3 mRNA expression was measured using NanoString expression profiling on formalin-fixed and paraffin-embedded tissue (N = 2355 HGSC) and MCM3 protein expression was assessed by immunohistochemistry (N = 522 HGSC) and compared with Ki-67. Kaplan-Meier curves and the Cox proportional hazards model were used to estimate associations with survival. Among chemotherapy-naïve HGSC, higher MCM3 mRNA expression (one standard deviation increase in the score) was associated with longer overall survival (HR = 0.87, 95% CI 0.81-0.92, p < 0.0001, N = 1840) in multivariable analysis. MCM3 mRNA expression was highest in the HGSC C5.PRO molecular subtype, although no interaction was observed between MCM3, survival and molecular subtypes. MCM3 and Ki-67 protein levels were significantly lower after exposure to neoadjuvant chemotherapy compared to chemotherapy-naïve tumors: 37.0% versus 46.4% and 22.9% versus 34.2%, respectively. Among chemotherapy-naïve HGSC, high MCM3 protein levels were also associated with significantly longer disease-specific survival (HR = 0.52, 95% CI 0.36-0.74, p = 0.0003, N = 392) compared to cases with low MCM3 protein levels in multivariable analysis. MCM3 immunohistochemistry is a promising surrogate marker of proliferation in HGSC

Functional Variants at the 11q13 Risk Locus for Breast Cancer Regulate Cyclin D1 Expression through Long-Range Enhancers

Analysis of 4,405 variants in 89,050 European subjects from 41 case-control studies identified three independent association signals for estrogen-receptor-positive tumors at 11q13. The strongest signal maps to a transcriptional enhancer element in which the G allele of the best candidate causative variant rs554219 increases risk of breast cancer, reduces both binding of ELK4 transcription factor and luciferase activity in reporter assays, and may be associated with low cyclin D1 protein levels in tumors. Another candidate variant, rs78540526, lies in the same enhancer element. Risk association signal 2, rs75915166, creates a GATA3 binding site within a silencer element. Chromatin conformation studies demonstrate that these enhancer and silencer elements interact with each other and with their likely target gene, CCND1